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Abstract 

We investigate the notion of H-subdifferential and H-normal map of a function 
u on the Heisenberg group, based on the sub-Riemannian structure of JH. We 
show that some properties of the subdifferential in the Euchdean setting are 
inherited. In particular, a characterization of the convexity of a function is 
given via the nonemptiness of the H-subdifferential dHu{g) at every point g. 
Concerning the H-normal map, we prove a monotonicity result when suitable 
strictly convex radial functions are considered. Finally, we suggest a definition 
of the Monge-Ampere measure of a function u via its H-normal map, and we 
extend a well-known integration result by Rockafellar. 
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1 Introduction 

The notion of subdifferential and normal map for a function defined on Euclidean 
spaces, or, more generally, in Banach spaces, is a classical concept (see, for instance, 
[22] . |18j). The most interesting features concern the properties of the subdifferential 
arising from convex functions. Indeed, in this case, it enjoys some more interesting 
properties, among them its uniqueness at a point characterizes the differentiability of 
the function at the same point. 

The notion of normal map has been exploited in order to define the weak solutions 
to the Monge-Ampere equation det D'^u = f (see, for instance, and the references 
therein). In particular, a pointwise estimate for convex functions, the Alexandrov's 
maximum principle, is of great importance in the theory of weak solutions for the 
Monge-Ampere equation; its proof relies on a monotonicity property of the normal 
map of convex functions, and it is based on geometric features of their graphs. 
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A natural question rises whether similar properties and maximum principle results 
can be stated in the more general setting of Car not groups or, more specifically, of 
the Heisenberg group. 

Many papers have been devoted to the study of different types of convexity in 
Carnot groups. Seemingly, the most interesting and fruitful notion of convexity is the 
so-called weakly H-convexity (see [6], In [6], in order to deal with the horizontal 

version of the Monge-Ampere operator in a Carnot group, the authors worked out a 
notion of horizontal subgradient and of horizontal normal map of a function u that 
are strictly related to the definition of weak H-convexity; in the paper, we will refer 
to weak H-convexity simply as to convexity. 

In [H], the authors investigated a Monge-Ampere type operator on the Heisenberg 
group, but they followed a different route with respect to the Euclidean framework 
(see [I2]), expressing their doubts about the existence of a suitable definition of normal 
map in IH useful to state maximum comparison results. 

The aim of this paper is to shed some more light about properties and potential 
of the normal map of a function in the Heisenberg setting. 

In Section [2] we provide the main definitions, while in Section [3] we define the 
H-subdifferential and the associated H-normal map for a function u : IH ^ M, that 
takes into account the sub-Riemannian structure of the Heisenberg group. 

In Section H] we state some results concerning the H-subdifferential of a convex 
function on M; in particular, we show that, for convex functions, the H-subdifferential 
is nonempty at every point. Moreover, the uniqueness of the H-subdifferential at a 
point go is equivalent to the existence of Xu{go). 

The main purpose of Section [5] is the investigation of the normal map dnu; in 
particular, we are interested in those properties of this map that are inherited from the 
corresponding properties of the map in Euclidean spaces. We show that the image of 
compact subsets of IH under the map dnu are compact subsets of Vi. Furthermore, we 
prove a monotonicity result for the H-normal map of strictly convex, radial functions 
satisfying an additional assumption. 

In Section [HI in order to show how the H-subdifferential of a function u carries 
much information about the function itself, we suggest a definition of the Monge- 
Ampere measure of u via its H-normal map, and we prove an extension of a well- 
known integration result due to Rockafellar. 

2 Basic notions 

The Heisenberg group H = is the Lie group given by the underlying manifold 
IR^ with the non commutative group law 

gg' = {x, y, t) (x', y\ t') = {x + x\y + y\ t + t' + 2{x'y - xy')) . 

The unit element is e = (0, 0, 0), and the inverse oi g = (x, y, t) is g^^ = (— s, —y, — t). 
Left translations and anisotropic dilations are, in this setup, Lg^^{g) = g^g and 
5x{x,y,t) = {Xx,Xy,XH) . 
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The differentiable structure on M is determined by the left invariant vector fields 

The vector field T commutes with the vector fields X and Y; X and Y are called 
horizontal vector fields. 

The Lie algebra of H, J), is the stratified algebra f) = IF^ = Vi ® V2, where 
Vi — span{X, y}, V2 — span{T}; (•, •) will denote the inner product. Via the 
exponential map exp we identify the vector aX-\-(5Y in [) with the point (a, (3, 7) 
in ]H\ the inverse ^ : IH [) oi the exponential map has the unique decomposition 

e=(6,6) with : if/ ^ V^.. 

The main issue in the analysis of the Heisenberg group is that the classical first and 
second order differential operators are considered only in terms of horizontal fields. 
For a given open subset C M, the class r'^(Q) represents the Folland-Stein space 
of functions having continuous derivatives up to order k with respect to the vector 
fields X and F; we denote as usual by C^iVt) the class of functions having continuous 
derivatives up to order k with respect to the differential structure of IF^. 

Let us recall that the horizontal gradient of a function it e (Q) at 51 e is the 
2-vector 

{Vnu){9) = {{Xu){g), {Yu){g)) , 

written with respect to the basis {X, Y} of Vi ; we denote by Xit the element in Vi 
defined as follows 

Xm = {Xu)X + {Yu)Y. 
The horizontal Hessian of m e F^(f]) at gf e O is the 2x2 matrix 

{^hUAQ} yiy^xu)){g) {Y{Yu)){g) ) ^ 
while the symmetrized horizontal Hessian is the 2x2 symmetric matrix 

Given a point ^ ^) the horizontal plane ifg^ associated to g^ is the plane in 
H defined by 

Hgo = (exp(li)) = {g = {x,y,t) e M : t = to + 2yoX - 2xoy} . 

Notice that, given g E IHgo, the set {go^xido^g), A G [0,1]} is the segment in if^g 
joining go with g (i.e., the convex closure, in the Euclidean sense, of the set {go,g})- 
We call it horizontal segment. 

By contrast with Euclidean spaces, where the Euclidean distance is the most 
natural choice, in the Heisenberg group several distances have been introduced for 
different purposes. However, all of these distances are homogeneous, namely, they 
are left invariant and satisfy the relation p{Srg', Srg) = rp{g', g) for every (7', g G 
and r > 0. In particular, the Euclidean distance to the origin | • | on f) induces a 
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homogeneous pseudo-norm 1 1 ■ 1 1 on () and, via the exponential map, on the group M 
in the following way: for f G f), with v = Vi + V2, f « G Vi, we let 

11^11 = 

and then define the pseudo-norm on IH by the equation 

pig) = Ml, iig = expv. 
The distance between g and g' is given by p{g^^g'). 

2.1 Pansu differentiability 

Let p be any homogeneous distance on IH; to simplify the notation, we denote by 
p{g) the distance p{g,e). 

Let u : M ^ IR''. We say that u is Pansu differentiable at g E IH ii there exists 
a G-linear map Du{g) : M IR^, i.e., a group homomorphism that satisfies the 
relation Du{g){6rh) = rDu{g){h) for every h E IH and r > 0, and such that 

\u{gh)-uig)-Duig)ih)\ 
p{h)-^o p{h) 

We call the map Du{g) the Pansu differential of u in g. 

The k X 3 matrix representing the Pansu differential Du of u = {u^,v?, . . . ,u^) can 
be written as follows 

/ Xu^ Yu^ \ 

Xu"^ Yu^ 

\ Xu'' Yu^ / 

The horizontal jacobian JHu{g) of m at (7 is defined by taking the standard jacobian 
of the matrix ([1]); to this concern see [8]. In the particular case A; = 1, an easy 
computation gives us that u is Pansu differentiable at g if 

Du{g){h) = hm ^(^^^(^)) - ^(^) (2) 

exists for every h G M. 

Moreover, if u G r^{lH), the Pansu differential Du{g) is given by the formula 

Du{g){h) = {^u{g),Uh)), 

for every g and h m M (see j^). 

Let us recall the following relevant definition concerning the degree of regularity 
of a function. 
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Definition 2.1 Let Q G IH he a bounded open subset, and < a < 1. A bounded 
function u : Q M is said to belong to the class r'''"(f2) if there exists a positive 
constant Lq, > such that 

\u{g)-uig')\<L^pig,gT, 9,9' e^. 

A function u G r'^'^(fi) is said to belong to the class r^'°'(i7) if both Xu and Yu exist 
in VL and Xu.Yu E r°'°(fi). 

As usual we say that u is Lipschitz continuous if m G r°'^; the symbol r|'^^(fi) 
denotes the class of locally Lipschitz continuous functions on Q. 

In the fundamental paper [21j, Pansu provides a Rademacher-Stefanov type result 
in the Carnot group setting; in particular, he proves that the Lipschitz continuous 
functions are differentiable almost everywhere in the horizontal directions. A further 
result, due to Danielli, Garofalo and Salsa ([7], Th. 2.7), will play a crucial role 
for some results in the sequel. We state it assuming that the Carnot group is the 
Heisenberg group. 

Theorem 2.1 Let Q be an open subset of M, and consider u : Q ^ M, with u G 
r°'-'^(f2). Then there exists a set E (Z fl of Haar measure zero such that the Pansu 
differential Du{g) and the horizontal gradient ^u{g) exist for every g E Q\E, and 

Du{g){h) = {Xu{g),^i{h)), for every heH. (3) 

Furthermore, Xu G L'^{Q). 

2.2 Convexity 

In the Heisenberg group, and in Carnot groups in general, several definitions of con- 
vexity have been introduced and studied for both sets (see [20], [3]) and functions (see 
[6], [H]). As a matter of fact, the results obtained in literature suggest that, among 
them, the most suitable and satisfactory is the notion of weak H-convexity. In the 
sequel, for the sake of brevity, we will refer to weak H-convexity as to convexity; to 
avoid misunderstandings, the classical convexity will be called Euclidean convexity. 

Definition 2.2 A subset Q of IH is said to be convex if, for every g E Q and for 
every g' E Hg nfl, 

gSxig-'g')En, VAg[0,1]. 

Definition 2.3 Let f2 be a convex subset of M. A function u : Q M is called 
convex if 

uigx)<uig) + \iuig')~uig)) (4) 
for all g E Q, g' E Hg fl Q, and A G [0, 1]. This is equivalent to say that 

u{gexp{Xv)) < u{g) + A {u{gexp{v)) - u{g)) 
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for every g E Q, v & Vi and A G [0, 1]. 

We say that u is strictly convex if is convex and the equahty in (jl]) holds, whenever 
g 7^ g', if and only if A = or A = 1. 

Observe that u is a convex function on Q if and only if u is Euclidean convex on 
any horizontal segment. 

In the sequel, without saying it explicitly, we will assume that the domain of a convex 
function is an open convex set. 

Next theorem (see, for instance, [6]) provides a useful second order condition for 
convexity, based on the behaviour of the symmetrized Hessian of u. 

Theorem 2.2 Let Q be an open convex subset of IH and let u G r^(^7). Then, u is 
convex on Q if and only if the symmetrized horizontal Hessian [(\/1u){g)]* is positive 
semidefinite for every g E fl. 

In |1] the authors provide a characterization of quasi-convex functions in C^{1H) 
involving the symmetrized horizontal Hessian as well. 

It is worthwhile to mention the following regularity result about convex functions 
on M due to Balogh and Rickly: 

Theorem 2.3 (see f^, Theorem 1.2) Let u : IH M be a convex function. Then 



3 H— subdifFerential and H— normal map 

Let Q' C M"^ be an open set. Let us recall (see p2j) that for every function f : Q' ^ M, 
the subdifferential of f at a point xq is defined as follows: 

df{xo) = {peM^: f{x)>f{xo) + {p,x-Xo), Vx G fi'}. (5) 

If df{xo) is not empty, we say that / is subdifferentiable at xq. 

The normal map of / is the set-valued function df : V{Vt') —>■ V{M"') defined by 

df{E) = U df{x), (6) 

for every E G Q'. 

In a notion of horizontal subdifferential that takes into account the sub- 
Riemannian structure of IH is given. 

Definition 3.1 Let u : Q —>■ M, with Q open subset of IH. The horizontal subdiffer- 
ential (or H-subdifferential) oi u aX g^ G is the set 

dHu{g^) = {peVi: u{g) > u{go) + {p.Ud) - UQo)), ^9 G Hg, n n}. 
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As in the classical context, we say that u is horizontally subdifferentiable (shortly, 
H-subdifferentiable) at go if dunigo) is not empty. Moreover, if p G dunigo), we say 
that p is a H-subgradient of u at g^. 

In the authors proved the following result: 

Proposition 3.1 (see Proposition 10.6). Let u be a function in r-^(fi), and 
VtdH open. If duu^g) ^ 0, then dnu^g) = {Xu{g)}. 

3.1 An equivalent notion of H— subdifferentiability 

In the Euclidean context another notion of subdifferentiability can be done and we 
say (see, for instance, and [15]) that / is subdifferentiable at xo E Q' C FT if 
there exists p G FT such that 

fix) > f{xo) + {p,x- xo) + o(|x - xol) (7) 

I — > 0. This notion is useful in the study of optimal mass transporta- 
tion problems together with the notions of c-subdifferentiability, c-convexity and 
Legendre-Fenchel transform. 

Recently, these concepts have been investigated in the framework of the Heisenberg 
group. For instance, in [1] the authors defined c-subdifferentiability and c-convexity 
for functions on M; in [5], taking into account the horizontal structure, the Fenchel 
transform was introduced for functions on M, and a characterization of convexity was 
provided. 

Starting from (JTj), another notion of H-subdifferentiability can be given: 

Definition 3.2 Let u : M M. We say that u is horizontally subdifferentiable at 
go eVlH there exists p eVi such that 

u{g) > u{go) + {p,^i{g) -6(^o)) + o(||Ci(^) -^i(^o)ll), for g G Hg^ and g ^ go. 

In next Proposition we show that, in the case of convex functions, the two notions of 
H-subdifferentiability given in Definitions 13.11 and 13.21 are equivalent. 

Proposition 3.2 Let u be a convex function. Then u is H-subdifferentiable at go (in 
the sense of definition \3.^) if and only if dunigo) is not empty. 

Proof: If dnu^go) 7^ 0, the u is trivially H-subdifferentiable at go according to 
Definition 13.11 Assume that there exists p E Vi such that definition 13.21 is fulfilled at 
go- Let us prove that p G dnuigo)- By contradiction, let g' G Hg^ such that 

u{g') - u{go) - (p, ii{g') - ^i{go)) =a <0. 
Define the function U : [0,1] M as follows: 

U{X) = u{gx) - u{go) - {p, ^i{gx) - ^i{go)) 
= u{gx) -u{go) - X{p,^i{g') -6(^0)), 
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where g\ = goSx{gQ ^g') varies along the horizontal segment [(?o, g'] as A varies in [0, 1]. 
The function U is Euclidean convex, t/(0) = 0, U{1) = a < 0; in particular, for every 
AG [0,1], 

f/(A) < (1 - A)f/(0) + At/(1) (8) 
= Aa. (9) 

At the same time, by the assumption of H-differentiability of u at g^, 

U{\) > o{\U9x - 9o)\\) = lUg') - 6(^?o)|| o(|A|), A - 0+ (10) 

Putting together ([8]) and ffTOl) . we get 

ll^i(^7')-6(^7o)||o(|A|)<A«, A^0+, 

or, dividing by A, 

WUg') - U9o)\\o{l) < a, A^0+, 
a contradiction, since a < 0. □ 

In the sequel, we prefer to deal with the notion of H-subdifferentiability of Defi- 
nition I3.1[ 



3.2 The Horizontal normal map 



The notion of horizontal normal map associated to the horizontal sub differential arises 
naturally: 

Definition 3.3 Let u : Q —>■ (— cxd,+cx3], Q open. The horizontal normal map of u 
(or H-normal map) is the set valued function dnu : V{Q) 'P{Vi) defined by 

dHu{E) = [j dffuig), 

g&E 

for every E dVt. 

One of the purposes of this paper is to establish whether the H-normal map can 
play a suitable role in dealing with the Monge-Ampere measure of a function (see 
[13] ) , or with some maximum or comparison principles for convex functions (see [1^ ) . 

Let us recall that, given a map T : V{VL) V{Y), where f2 C X, the graph of JF 
is defined as the set 

{{x,y) gXxY: x eVL,y e J^{x)}. 

A possible extension of the concept of continuity of a function to maps is provided 
by the notion of closed graph. 

Definition 3.4 Let X, Y be topological spaces. A map JF : X ^ ^(Y) is said to 
have closed graph if for every C X, ^ x G X, {?/„} C Y, with ?/„ G F(x„), 

then 

Vn^y e F{x). 
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4 H— subdifFerentiability and convex functions 



The aim of this section is to investigate some properties of the H-subdifFerential and 
of the H-normal map of convex functions on M. Our main result is Theorem 14.11 
where a convex function is characterized via its H-subdifferentiabihty on the domain. 
As a consequence, the uniqueness of the H-sub differential of a convex function u at 
a point g is equivalent to the existence of ^u{g). 

If u : Q ^ M is convex, then, for every G fi, the limit 

^.^ u{gexp{Xv)) - u{g) 

A^0+ A 

exists in R, for every f G Vi. We set 

u{g exp{Xv)) - u{g) 

u[q;v)= lim ^ . 

^ ' A->0+ A 

Let us first state the following useful characterization of H-subdifferentials of a 
convex function. 

Proposition 4.1 Let u : Q —>■ M be a convex function, and g eVL. Then p G dHu{g) 
if and only if 

u{g;v) > {p,v), for every v G Vi. (11) 
In particular, if u is Pansu differentiable at g and ^ holds, then 

Xu{g) G dHu{g). 

Proof: Suppose that p G duu^g). Hence, for every A G [0, 1] and f G Vi, we have 

«(5(exp(Ai;)) > u{g) + \{p,v). 
The previous inequality (|T2l) holds if and only if 

u(5(exp(Aw)) - u{g) 



A 



for every A G (0, 1] and f G V^i : hence ffTTl) follows obviously. 

Conversely, assume that (fTTj) holds. Since u is convex, we have 

u{g ex-piyXv)) < u{g) + X{u{gexp{v)) - u{g)), (12) 

for every A G [0, 1] and v eVi.Bj and ([12]) we get that 

{p,v) < hm r <u{gexp{v)) - u{g), 

A^0+ A 

for every v E Vi, hence p G dnu^g). 
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Let us suppose now that u is Pansu differentiable at g and ([3]) holds; then, by ([2]), 

A— >0+ A 

for every h E M. The convexity of u gives us that '^^9Sxihy)~u{g) (^Q^j-eases when A ^ O"*", 
for every fixed g and h E H^. Hence 

{Xu{g},^i{h)} < , VAg(0,1J, 

so that Xm((7) is a H-subdifferential. □ 

In [6], DanieUi, Garofalo and Nhieu proved the following 

Proposition 4.2 (see iGjj, Proposition 10.5). Let u : Q ^ M, where Q is an open 
and convex subset of M. If dHu{g) ^ for every g E Q, then u is convex. 

In order to show that the converse holds, we need next result. Indeed, the following 
Lemma will be crucial also in the proof of Theorem 15.11 

Lemma 4.1 Let he an open subset of IH, and consider a function u E C{VL). Then 
the map dnu : V{Q) 'P(^i) has closed graph. 

Proof: We prove the lemma by contradiction. Assume that go E Q, and there exist 
sequences {gn} C fl and {pn}, with p„ E dnu^gn), such that 

9n go, Pn^P, pi dnuigo). 

Consequently, there exists g' E Hg,^ fl Q such that 

u{g') - u{go) = {p, ^i{g') - ^i{go)) - a, 

for a suitable a > 0. From the assumptions, u is continuous. 

Denote by B{e, r) the set of points g E M such that p{g) < r. Let us consider the 
balls B{e,r) and B{e,r') in such a way that 

i) \u{g'h') — u{g')\ < a/10, for every h' E B{e,r')] 

ii) \u{goh) — u{go)\ < a/10, for every h E B{e,r); 

iii) Hg^h n Lg,{B{e,r')) ^ 0, for every h E B{e,r). 

The reader can easily convince himself that such balls exist using suitable continuity 
arguments on u and on the displacement of the horizontal planes of points moving 
close to others. For every h E B{e,r) and h' E B{e,r'), i) and ii) imply the following 
inequality: 

- 6(^o)) - a = u{g') - u{go) 

> u{g'h') - u{gQh) - a/5. (13) 
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Take such that Qn G Lgg{B{e,r)) for every n > N, and denote by hn the point in 
B{e,r) such that Qn = gohn- Notice that hn — > e. Moreover, from the choice of the 
balls, there exists h'^ G B{e, r') such that 

9n = g'h'n^ Hg,h„, g'n^g'. 

Then, taking into account the assumptions and (fT3l) . we get 

(P, ^lig') - ^ligo)) - a > u{g'h'n) - u{gohn) - a/5 

> {Pn^^iig'Ki) - ^ligohn)) - a/5 

> \im'mf{pn,^iig'h'J ~ ^i{gohn)) - a/5 
= (P, 6(^0 -Ci(^o)) -a/5, 

therefore obtaining 

{P,^i{g') -6(^0)) -a> {p,^i{g') -^i{go)) - a/5, 
a contradiction. □ 
We are now able to prove the following interesting characterization: 



Theorem 4.1 Let u : Vt d M —^ IR, where Vt is open and convex. Then u is convex 
if and only if, for every g G M, dHu{g) 7^ 0. 

Proof: The "if part is the result of Proposition 14.21 

From Theorem 12.31 any convex function u belongs to r|'^^(f2); in particular, it 
is continuous. By contradiction, we assume that there exists go & Q such that 
dHu{go) = 0. Let us consider a neighborhood B{e, r) of the origin such that u belongs 
to T^'^{Lgg{B{e,r))). From Theorem 12. 11 there exists a subset E of Lgf^{B{e,r)) with 
null measure such that for every g G Lg^^{B[e, r))\E there exists the Pansu differential 
Du{g) and ^ holds; Proposition 14.11 shows that, for such g, Xui^g) G dnu^g). Since 
Vhu G L°°{Lgg{B{e, r))) (see [B], Theorem 9.1), there exists k such that ||Xm((7)|| < k, 
for a.e. g G Lg^^{B{e,r)). Therefore there exists a sequence {gn} in Lgf^{B{e,r)) \ E 
such that 

gn go, ^u{gn) p, ^u{gn) G dnuign), 

for some p G Vi. Then, since dnu has closed graph (see Lemma I^TTl) . p G duu^go), a 
contradiction. □ 

As a matter of fact, the uniqueness of the H-subdifferential for a convex function 
characterizes the H-differentiability. We are able to state the following 

Theorem 4.2 Let u he a convex function on Vt. Then, ^u{g) exists for some g E Q 
if and only if u has a unique H-subgradient at g. Moreover, in both cases, we have 
that dHu{g) = {Xu{g)}. 
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Proof: Let u be convex. By Theorem I4.H there exists p = piX + P2Y G dHu{g). By 
Proposition 14.11 if we put h = (1, 0, 0) G H^, we get 

Pi = {P,^i{h)) 

< j.^ u{g5xih)) - u{g) 
~ x^o+ X 

ujgexpjXX)) - u{g) 

A-+0+ A 

Now, taking h = (—1,0,0) G He, similar computations give 

u{g exp{XX)) - u{g) 

— Pi < — hm . 

A^o- A 

Hence, we have 

.^ n(,exp(AX))-n(,) ^ 

A^O A 

Similar arguments show that p2 = Yu{g). 

Conversely, assume that dHu{go) = {p}. Let us suppose Q = IH, for the sake of 
simplicity. Fix v E Vi, and consider the linear space C{v) = {av, a G M}. Define on 
C{v) the linear functional 

L^{w) = au'{go;v), 

for w = av. Notice that L^{w) = u'{gQ] w) whenever w = av, with a > 0. Indeed, 

, u{goexp{Xw)) - u{go) u{go exp{Xv)) - u{go) 
u igo;w] = lim = lim a = LJw). 

A^0+ A A->0+ A 

By the convexity of u, the function t u{go exp{tv)) is Euclidean convex; in partic- 
ular, the following inequality holds 

u'igo; -v) > -u'igo;v). 

Assume that w = av, with a < 0. Then 

u'igo; w) = u{go; av) = {-a)u{go; -v) > au'{go; v) = L^{w). 

Since the linear functional satisfies on C{v) the inequality 

Lv{w) < u'{go;w), 

by the Hahn-Banach theorem there exists p^ G Vi such that 

{Pv, w) < u{go; w), Ww e Vi. 

From Proposition 14.11 p^ G dHu{go), and, by the assumptions, p^ = p. In particular, 
Py is independent on v. Since {p,v) = u'{go;v), and v is any vector in Vi, we can 
conclude that 

{p,v) =u'{go;v), \fveVi, 
thus u'{go; ■) is linear on Vi. Hence, ii w = X then 

u \ u \ 1- M(^oexp(AX)) -n(^o) 
u [go; w) = -u [go; -w) = hm . 

A— >0 A 

This implies the existence of Xu{go), that should be equal to u'{go; X). Similar argu- 
ments prove the existence of Yu{go); in particular, p = Xu{go)X + Yu{go)Y. □ 
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5 The H— normal map 



The aim of this section is to investigate some properties of those subsets of Vi that are 
images, via the H-normal map, of subsets of Q. We start by studying the properties 
of the H-normal map of a single point, i.e. the H-subdifferential. 

Proposition 5.1 Let u : Q M, with Q G IH open; let g & Q. Then dunig) is a 
convex set. Moreover, if u is locally bounded, then dunig) is compact. 

Proof: Take any pi,p2 G dHu{g). For every A G [0, 1] we have that 
u{g') = {1 - X)u{g') + Xu{g') 

> (1 - A) {u{g) + {puUg') - Ug))) + + (p2, Ug') - Ug))) 
= u{g) + ((1 - A)pi + Ap2, Ug') - Ug)). 

for every g' G if^, therefore showing that (1 — A)j9i + \p2 is a H-subgradient of u. 

Let {pk} be a sequence in dunig)- For every k and for every w & Vi, with | |w| | = 1, 
we have 

u{g6x{exp{w))) > u{g) + {pk, ^i{g5xiexp{w))) - ^i{g)) = u{g) + X{pk,w). 
In particular for every k with p^ 7^ 0, if we put w = Pk/\\Pk\\, then we obtain 

sup u{g5xiexp{w))) >u{g) + -r^{pk,Pk) = u{g) + X\\pk\\. (14) 

|u>||=l \\Pk\\ 

Take any A sufficiently small such that g6x{exp{w)) G Q for every w with ||w|| = 1 : 
since u is locally bounded, ffn|) gives us that {pk} in a bounded subset of Vi. Hence 
there exists a convergent subsequence {pk„} such that pk„ — > p. Clearly 

u{g') > u{g) + {pk„,Ug') - Ug)), 

for every n and for every g' G IHg fl Q. Letting n 00, we obtain that p G dHu{g). □ 

The investigation of the images of the H-normal map is actually more awkward. 
Indeed, if we shift from a point g to another point g', and consider p G dHu{g) and 
p' G dHu{g'), then the H-subdifferentials p and p' support the function on the different 
planes Hg and Hg'. 

First of all, it easy to see that, as in the Euclidean case (see [I2]), if K is Euclidean 
convex, then dHu{K) is not necessary Euclidean convex in Vi. 

To obtain information about duni^), we need some regularity assumptions on u. 

Proposition 5.2 Let u : Q IR and u G r'^'-'^(fi), with Lipschitz constant L. Then 
\\p\ \ < L, for every p G duuiS^)] in particular, duni^) is a bounded set. 
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Proof: Let p G duni^)- Then there exists g & fl such that, for every h E e X > 0, 
we have 

A 

Since u is Lipschitz continuous, there exists L > such that \u{g) —u{g')\ < Lp{g, g'), 
for every g' E Q. Hence 

ujgSm) - u{g) ^ 
A 

The previous two inequahties give us that 

{p,Uh))<Lpih), 

for every h G Hf.. If we put h = ^i^{p), we obtain < □ 

Theorem 5.1 Let u : Q ^ M be a function in r||^^(r2). Then, for every compact set 
K G Q, the set duniK) is compact. 

Proof: By the assumption, for every g E Q there exists a neighborhood Bg such that 
u G r^'^{Bg), i.e., there is a constant Lg such that 

\uig")-uig')\<Lgp{g",g'), 

for every g", g' E Bg. 

Let K be any compact subset of Q; then K C UfLiBg- for a suitable finite set of 

points {5-1, 5-2, • • • ,5'Jv}- 

Take any p G duniK), and denote hj g a point in K such that p G dunig) C 
dHu{Bg.), for some Hence, by Proposition 15. 2[ since u G r°'^(Sg-) for every i = 
1,2, . . . , N, we have that 

\\p\\<Lg^<ma^{Lgr. l<t<N}. 

Hence duniK) is bounded. 

Let us now consider a sequence {pn} C duniK), and assume that p„ — ^ p, and 
denote by gn a point in such that p„ G duu^gn)- Since in compact, there exists 
a subsequence {fifn^} such that gn^. g for some g E K. Since the normal map dnu 
has closed graph (see lemma HIT]) . p G dnu^g). □ 

Next result follows trivially from Theorems 15.11 and 12.31 

Remark 5.1 Let m be a convex function on Q. Then, for every compact set K (Z fl, 
the set duff^K) is compact. 
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5.1 Monotonicity property of the H— normal map 

The purpose of this subsection is to investigate whether, as in the Euchdean context, 
a monotonicity property of this type holds: 

Problem 5.1 Let Q G IH he open and bounded, and denote by u and v two convex 
functions such that 

uig)=vig), ygeOn 

and 

u{g) < vig), yg e n. 

Then 

dHv{n) c dHu{n). 

We are not able to prove the result in the general case; at the moment, several 
difficulties rise in the proof. In the sequel we will consider a particular case of the 
situation described in Problem flS.ip : we assume to work with functions u : M ^ IR 
with the following property: 

uix,y,t) = U{r,t), 

for every (x, y, t) where r = \/ x"^ + y"^. By abuse of language, we will call these 
functions "radial". 

We think that the ideas contained in the proof of this special case could be of some 
interest to deal with the general one. 

For every t E M and i? > 0, we will denote by C{t, R) the set 

C{t,R) = {{x,y,t)eH: x^ + y^ = R'}, 

and by D(t,R) the "open" disc in -f^(o,o,t) defined by 

D{t, R) = {{x,y,t) e M : x^ + y^ < R^}. 

In order to prove our monotonicity result, we need to state the following techni- 
cal propositions, that explains some geometric features of the normal map of radial 
functions. 

Proposition 5.3 Let u : IH M be a radial, convex function in C^{1H). Then, for 
every t E M and R> 0, 

dHu{C{t,R)) = {peVi: \\p\\ = R'}, 

for a suitable R' > 0. 

Proof: Under the assumptions, for every g & M the map dnu : IH ^ Vi is single- 
valued, and dnu^g) = {Xu{g)} (see Theorem 14. 2p . 
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For every g = {r cos 0, r sin 0, t) G we have 

Xu{g) = Ur{r,t) cos 6* + rUt{r,t) sin 9, Yu{g) = Ur{r,t) sin 6* — rUt{r,t) cos 9, 
and 

||X«(^?)|| = ^U^{r,t)+4r^U?{r,t). 
If 6* varies in [0, 2tt) we get the thesis. □ 

Proposition 5.4 Le^ u : IH ^ M be a radial, convex function in C^{1H). Denote by 
Q the (nonempty) sublevel set 

n={geH: u{g) < 0}. 

Then, Ohu^Q fl if(o,o,t)) is a disc (open or closed) in Vi, centered at the origin. Con- 
sequently, the set dnu^Q) is a disc (open or closed) in Vi, centered at the origin. 

Proof: Notice that 

and f2niJ(o,o,t) = D(t, R(t)). By Proposition 15.31 and by the continuity of Xu we easily 
get the thesis. □ 

We would like to emphasize that, in general, ||Xu(rcos6',r sin^^,t)|| is not an 
increasing function of r; this explains why, without further conditions on u, one 
cannot infer that dHu{dD{t,R)) = d{dHu{D{t, R))). The radius R of dHu{D{t,R)) 
is given by the expression 

R{t,R) = sup{||XM(rcos^,rsin^,t)||, < r < R, 9 e [0,27r)}. 

Theorem 5.2 Let u G C^{1H), v G C^{IH) be radial, strictly convex functions such 
that u < V. Denote by Q the (nonempty) level set 

n = {geH: u{g) <Q} = {ge]H: v{g) < 0}; 
assume that Vt is bounded and 

dQ = {ge]H: u{g) = 0} = {g e H : v{g) = 0}. 
If'g& dQ, then there exists s = s{g) G (0, 1] such that 

Xv{g) = sXu{g). 

In addition, suppose that the function V defined as V{r,t) = v{x,y,t) satisfies in fl 
the assumption 

T^Vl - VrVrr < 0. (15) 

Then, 

duviSl) C duuiSl). (16) 
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Proof: Take any point g = (x, y, t), such that g G c?finiJ(o,o,i)- Notice that Xm(^) 7^ 0, 
since u is strictly convex and Xm(0, 0, t) = 0. 

Let us consider the function Fj : — > M obtained by restricting u to Hg and 
defined as follows: 

Fji^^y) = u{x,y,t + 2yx - 2xy). 
Denote by Qj the sublevel set 

n^ = {ix,y)eR': F^{x,y)<0}, 

and consider, in particular, its boundary 

dn^ = {{x,y)elR': F^{x,y) = 0}. 

This set is not empty, since Fj(x,y) = 0; moreover, from the inequality 

dF^ dF- 

^u{g) = -Q^{x,y)x + -Q^{^,y)y + 0, 

the implicit function theorem assures that, at least locally, there exists a unique curve 
Ig-.l ^ M\ 75Ks[= {x{s),y{s)), with G C\l) and F^{x{s),y{s)) = 0; 

moreover, V F^ix^y) is orthogonal to 7g(0)- Since VFj{x,y) represents the increasing 
direction of F-^ at the point (x,y), the vector —V F^i^^y) points towards this 
imphes that ((x, — zV F^ix^y)) belongs to at least for small values of ^ > 0. 

Let us start from the function v instead of u. By the same arguments applied to 
F^ = v{x, y,t + 2yx — 2xy), taking into account that, from the assumptions on u and 
V, we have Qj = Qj, we find out that VFj(x,y) and VFj(x,y) should satisfy the 
equality 

WF^{x,y) = sVF^{x,y), 
for some positive s; in other words, 

Xv{g) = sXuCg). (17) 

Let us prove that s < 1. Consider the functions defined in [0, e) for a suitable 

small e as follows 

nz) = F^{ {x, y) - zVF^ (x, ) , r{z) = F| ( (x, y) - zVF^ (x, y) ) . 

Since /"(O) = /''(O) = 0, and /"(-z) < /"(-z) < if < 2; < e, standard arguments 
of real analysis entail that (D'(0) < (D'(0) < 0. From (/")'(0) = -||Xu(^)||2 and 
= -||Xt;(^)||2 = -s2||Xm(^)||2, we obtain that s < L 
Let us consider the function 

r ^ \\Xv{g)\\^ = V;2(r,t) +4rV,2(r,t), 

where g = {r cos6,r sin6,t). By the assumption (ITSl) . standard computations imply 
that this is an increasing function; in particular, from Propositions 15.31 and 15.41 

dHv{d{Q n H(^o,o,t))) = d{dHv{Q n if(o,o,t))). 
17 



Moreover, taking into account that (fT7|) holds with s < 1, we get 

dnvin n i^'(o,o,t)) C dnuin f] i^'(o,o,t))- 

Suppose now that p is in dnvi^fl), i.e., p = Xv^g') for some g' = {r' cos9,r' sm9,t') e 
Then 

p e 9Ht;(C(t',r')) c dHv{nnH^o,o,t')) c ^^^(nn i/(o,o,t')), 

thereby proving flTBl) . □ 
Following the idea in [2], we consider radial functions of the type 

vix,y,t) = {ix' + y'f + z{t)Y/\ 

where z : M ^ M is assumed to be twice continuously differentiable and positive. 
Theorem 12.21 and easy computations (see [4J) show that u is convex on IH if and only 
if 

Az{l + z") > 3{z'f, on R. 
Condition f|T5|) is equivalent to the inequality 

lQ{z{t)y + r\lQz{t) - {z'{t)y) > 0. 



6 Applications 

The aim of this section is to show that, like in the Euclidean framework, the H- 
subdifferential of a function on the Heisenberg group carries a lot of information 
about the function itself. 

6.1 The Monge— Ampere measure and H— normal map 

In the Heisenberg group, the Monge- Ampere type operator Sma (see [TT] and [H]) is 
a fully nonlinear operator on u defined by 

Sma{u) = det[V^M]* + ^{[X,Y]uf = det[V^«]* + 12{Tuf 
In [13] the authors proved the following result: 

Theorem 6.1 Given a convex function u G C{Q), there exists a unique Borel measure 
such that, when u G C'^{VL), 

fiu{E) = / [Sma{u)]{g)dg, 

J E 

for any Borel set E G Q. 
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We call flu the Monge- Ampere measure of u. 

In the Euclidean context (see [12]), the Monge-Ampere measure Mf associated 
to a function / is defined via the notion of normal map df of / (see (|5]) and ([6])). In 
particular, if / G C{Q'), with Q' open in iR", the Monge-Ampere measure is the set 
function Mf : £' ^ [0, oo] defined by 

Mj{E') = \df{E')\= f Idp, WE'eS', (18) 

Jdf{E') 

where S' = {E' C Q' : df{E') is Lebesgue measurable} and \A\ denotes the Lebesgue 
measure of A. If / is an Euclidean convex function in C^(f2'), we have that 

Mf{E')= I det[D'^ f]{x)dx, (19) 
Je' 

for every Borel set E' C Vl' . The proof of (|T9ll (see [I2]) exploits the property that if 
/ is Euclidean convex and C^(r2'), we can identify df with V/ and V/ is one-to-one 
on the set {x G fi' : D'^f{x) > 0}. Hence every point p G df{E') is the image of a 
single point x E E' : this is the reason to put the integrand function in f|T8l) equal to 
1, for every p G df{Q'). 

Our purpose is to suggest a definition (see Theorem 16.31) of the Monge-Ampere 
measure of u in the Heisenberg context, on the analogy of the Euclidean framework, 
using the H-normal map dnu of u. 

We know that if m is a convex function in r^(fi), then dnu^g) = {V Hu{g)}; however, 
it is unreasonable to require that Vhu : — > Vi is a one-to-one map, since VL (Z M 
and Vi is essentially . In other words, every point v G dHu{E) is the image of a 
set of points C E. Therefore we need to replace the weight "1" in integral ( fTSl) 
with a convenient weight. For every p G Vi, the weight of p will be the 2-dimensional 
spherical Hausdorff measure of S^. 

In order to do this, we recall the following coarea formula proved by Magnani in 
[TU] . We refer to [H] for all the relevant definitions about spherical Hausdorff measures. 



Theorem 6.2 Let F : IR^ be a Lipschitz map, where Vl <Z M is a measurable 

set. Then, for every measurable function ^ : i7 [0, oo], the following formula holds 

[ z{g)JHF{g)dg= [ ( [ z{w) dSlj{w)] dv, (20) 

Jn Jm^ \JE~'^{v)nn / 

where dS\j denotes the 2-dimensional spherical Hausdorff measure. 

Let u be a convex function in r^(n), and consider the function F : VL ^ IR^ 
defined by F{g) = {Xu{g),Yu{g)). Clearly, 



DFig) 



XXu{g) YXu{g) 
XYu{g) YYu{g) 
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Standard computations give us that 

JuF^g) = det[V]ju]{g) = det[Vlu{g)r + A{Tu{g)f . 
If we consider z = 1 and E G measurable, by the formula ( l20l) we obtaiE0 

{det[{Vlu){g)Y + A{{Tu){g)f)dg = [ JHF{g)dg 

E J E 

dS'\j{w) ) dv 



{Sl,{{VHu)-\v)nE)) dv 

IB? 

dHu{E) 

where, for every v G JR^, the set C M is defined by 

j:f = En[iVHu)-\v)]. (21) 

Taking into account the arguments above, we state the following theorem where 
a possible definition for a Monge-Ampere measure associated to u is provided. 

Theorem 6.3 Let u G r°'^(f2), with VL open in M. Let us consider the function 
: £^ ^ [0, oo] defined by 



u^{E)= I Sl,{Ef)dv, \/Ee£, 

Jd„u(E) 



IdHuiE) 

where is given in l[21\) andS = {E G Q : E and dHu{E) are Lebesgue measurable}. 
Then 

i. Vu is non negative and a-additive; 
a. if u is convex and u G r^(fi), then 

v^{E)= [ {det[{Vlu){g)r + A{{Tu)ig)f)dg 
Je 

for every E E £. 

We call z/, with an abuse of language, the Monge-Ampere measure associated to u. 
Up to now, we are not able to prove that £^ is a a-algebra. Indeed, while it is quite 
trivial that the numerable union of sets in £ is still a set in it is not clear what 
happens about the complement of a set in £. Notice that, for every E E £, we have 

dnuiE") = {dHu{n) \ duu^E)) U {duuiyt \E)n duu^E)) . 



^we identify dHu{E) with a subset of IB? , as we did with V Hu{g). 
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The main problem is to show that dnuiVL \ E) n duui^E) is Lebesgue-measurable; 
notice that, in the Euchdean framework, this set has null measure. 

Proof: First of all, let us notice that for every E E £ and for every f G Vi, the set 
is a Borel set; from the Borel regularity of S\j, the set is 5|:^-measurable. 
Let us consider a sequence {Ei\°t^^ of disjoint sets in £. It is straightforward that 

Yi^iEi = UjSf% and is a family of disjoint subsets of Vt. We get 

i 

Hence, Hu is cr-additive. Clearly, ii. is obvious for previous computations □ 



6.2 The Rockafellar function in ]H 



In the Euclidean framework, as well as in the more general Banach setting, a convex 
function can be detected using its subdifferential at every point via the Rockafellar 
function (for a new and recent proof, see pLGj). We are going to prove that a similar 
integrability property is inherited by convex functions on the Heisenberg group, where 
the H-sub differential plays nearly the same role. Indeed, the following result holds: 

Theorem 6.4 Let u : IH M be a convex function. Then, 

u{g) = u{go) + sup <^ y^iPi, - \ , (22) 

^ U=o J 

were 

'P = [{{9i,Pi)}7=o '■ 9i+i e Hg^, gn = g, PiE dnuigi), n > o|. 

Proof: Since ii g = go the result is trivial, we will assume g ^ go- From Theorem 14.11 
dHu{g) 7^ 0, for every g. By the definition of H-sub differential, for every sequence 
{{ghPi)}l=o CV we have that 

u{gi+i) > u{gi) + - ^i(^i)), 

for every i, Q < i < n — 1. Adding both sides of these inequalities, we obtain 

u{g) > u{go) + ^{Pi, ^i{gi+i) - ^i{gi))- (23) 

i=0 



21 



Thus, the left-hand side of (!22|) is greater than or equal to its right-hand side. 
Since gi+i G Hg^ if and only if Qi G -ffg.+i, from pj+i G ^^^(fi'i+i), we get that 

u{gi) > u{gi+i) + {pi+i,^i{gi) - 

Then, 

u{gi+i) - u{gi) - (pi, ii{gi+i) - ii{gi)) < (pi+i, ^i{gi+i) - ^i{gi)) + 



for every i, < i < n — 1. Hence, taking into account (1231) . we obtain: 

n— 1 n— 1 

< u{g)-u{go) - ^(pi, ^(^i+i) - ^i(^i)) < ^{Pi+i - Pi,^i{gi+i) -^i{9i)), (24) 

In order to prove (!22|) . we will show that, for every e > 0, there exists a finite 
sequence in V such that 

n—l 

^{Pi+1 - Pi, ^i{9i+i) - ^i{9i)) < e- (25) 

i=0 

Let us consider, first, the case ^i(5'o) = ^i{9)i this implies that g ^ Hg^^ Choose 
g' G Hg^ and g" G iJ^/ H iJ,,; from g^ ^ g' e Hg^, we have that ^1(51') 7^ ^1(51) and 
hence Hgi flifg 7^ 0. Take po G dunigo), p' G dunig'), p" G dunig") and p G dunig)- 
For every e > 0, denote by a positive integer such that 

6iV > {p'-p,,^,{g')-^,(g,)) + (/_p',^,(/) _^,(^')) + _^^(^")) (26) 

We will single out a set of points {Pn}o^ on the broken line [go,g'] U [g',g"] U 
Indeed, let us consider a particular sequence {{gi,Pi)}^=Q in P defined as follows: 

i) for i = 1, ... - 1, we pick out gi G [5-0, 9'] C Hg^ such that ^i(5(i) = (6(fi'') - 

6(^o))VA^ + ei(^7o); 



n 
iii 



IV 

V 



VI 

vii 



we set gN = g' and p^ = p'; 

for i = N + 1, . . . 2N — 1, we pick out g^ G [g', g"] CG Hg/ such that ^i{gi) = 
{U9")-U9'm^-N)/N + U9'); 

we set g2N = 9" and p2N = p"; 

for i = 2N + 1, . . . 3A^ — 1, we pick out gi G [g", g] CE Hg such that ^i{gi) = 
{U9)~U9"))i^-2N)/N + U9"); 

we set gsN = g and psN = P ■ 

for every i, with 1 < i < 3N — 1 and i different from and 2A^, we choose 
Pi G dunigi)- 
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Notice that gi+i G Hg^, for every i, < i < 3N — 1. From i)-vii) and (l26ll . we 
obtain 



3Af-l 



^N-l 27V-1 3Af-l\ 



1=0 i=N i=2N/ 
N-1 27V-1 



J2(P^+^-P^'^^^9')~U9o))/N+ J2 {P^+i-P^^U9")-U9'))/N + 



i=0 i=N 
ZN-l 



+ J2^P^+^-P-^^^9)-U9"))/N 



i=2N 

^ {Pn -po,^i{9') -^i{9o)) {P2N -Pn,^i{9") -^1(9')) 
N N 

{P3N -P2N,^1{9) -^1(9")) 

N 

< e. 

Hence (ES]) holds. 

If g ^ Hg^ and ^1(5') 7^ ^i(fi'o)5 we set g' = go and choose g" G Hg^ fl Hg. The proof 
is similar to the previous case. 

Finally, if G Hg^, we set g' = go and g" = g : again, the proof follows the line of 
the previous case. □ 
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